(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19)WorldlntenectualPropertyOrga„ization 

(43) International Publication Date (10) ^'^'^'^j^^'^^Z^]^^^^^ 

8 February 2001 (08.02.2001) PCT WO 01/09592 Al 

(51) International Patent Classification^ GOIN 21/64, Dartmouth Place, LaCanada-Flintridge, CA 910U (US). 

33/543 LANSFORD, Russell, D.; 522 RMiramar Avenue, Clare- 

mont,CA 91711 (US). 

(21) International Application Number: PCr/USOO/20591 

(74) Agent: REED, Derrick, W.; Christie, Parker & Hale, LLP, 

(22) International Filing Date: 28 July 2000 (28.07.2000) rq. Box 7068, Pasadena, CA 91 109-7068 (US). 

(25) Filing Language: EngUsh ^54^ designated States rregiowa/): European patent (AT, BE, 

. CH, CY, DE, DK, ES, FI, PR, GB, GR, IE, IT, LU, MC, 

(26) Publication Language: English NL, PT, SE). 

(30) Priority Data: „ . . , 

60/146,490 30 July 1999(30.07.1999) US Published: 

60/164,504 9 November 1999 (09.11.1999) US " ^//^ 

' — Before the expiration of the time limit for amending the 

(71) Applicant: CALIFORNIA INSTITUTE OF TECH- ^'-'"^ republished in the event of receipt of 

NOLOGY [US/US]; 1200 East California Boulevard, amendments. 
Mail Stop 201-85, Pasadena, CA 91125 (US). 

For two-tetter codes and other abbreviations, refer to the "Guid- 
5 (72) Inventors: BEARMAN, Gregory, H.; 974 East EUza- ance Notes on Codes and Abbreviations" appearing at the hegin- 
l beth, Pasadena, CA 91 104 (US). ERASER, Scott, E.; 503 ning of each regular issue of the PCT Gazette. 



= (54) Title: SYSTEM AND METHOD FOR MONITORING CrELLULAR ACT! VTTY 


















Abe 
1 


— » 




1 

18 


MM 




J 

4u 



(57) Abstract: A system and method for 
monitoring cellular activity in a cellular 
specimen. According to one embodiment, a 
plurality of excitable markers are applied to the 
specimen. A multi-photon laser microscope 
is provided to excite a region of the specimen 
and cause fluorescence to be radiated from 
the region. The radiating fluorescence is 
processed by a spectral analyzer to separate 
the fluorescence into respective wavelength 
bands. The respective bands of fluorescence 
are then collected by an array of detectors, 
with each detector receiving a corresponding 
one of the wavelength bands. 
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SYSTEM AND METHOD FOR MONITORING CELLULAR ACTIVITY 



CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is based on provisional patent application numbers 60/146,490 filed 
July 30, 1999, and 60/164,504 filed November 9, 1 999. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
DEVELOPMENT 

The invention described herein v/as made in the performance of work under a NASA 
contract, and is subject to the provisions of Public Law 96-517 (35 USC 202) in which the 
Contractor has elected to retain title. 

FIELD OF THE INVENTION 

The present invention relates to the monitoring of cellular activity through the use of 
excitable markers. More particularly, the invention relates to a system and method for using a 
plurality of fluorescent probes to monitor cellular activity. 

BACKGROUND OF THE INVENTION 

Presently, fluorescence microscopy is one of the most widely used microscopy 
techniques, as it enables the molecular composition of the structures being observed to be 
identified through the use of fluorescently-labeled probes of high chemical specificity, such as 
antibodies. However, its use is mainly confined to studies of fixed specimens because of the 
difficulties of introducing antibody complexes into living specimens. For proteins that can be 
extracted and purified inreasonableabundance, these difficultiescanbecircumventedby directly 

conjugating a fluorophore to a protein and introducing this back into a cell. It is believed that the 
fluorescent analogue behaves like the native protein and can therefore serve to reveal the 
distribution and behavior of this protein in the cell. 

An exciting, new development in the use of fluorescent probes for biological studies has 
been the development of the use of naturally fluorescent proteins as fluorescent probes, such as 
greenfluorescentprotein(GFP).Thegeneforthisproteinhasbeenclonedandcanbetransfected 

int6 other organisms. This can provide a very powerful tool for localizing regions m which a 
particular gene is expressed in an organism, or in identifying the location of a particular protem. 
The beauty of the GFP technique is that living, unstained samples can be observed. There are 
presently several variants of GFP which provide spectrally distinct emission colors. 

Conventionally, fluorescence microscopy only worked well with very thin specimens or 
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when a thick specimen was cut into sections, because structures above and below the plane of 
focus gave rise to interference in the form of out-of-focus flare. However, this can be overcome 
by optical sectioning techniques, such as multi-photon fluorescence microscopy. 

Multi-photon fluorescence microscopy involves the illumination of a sample with a 
wavelength around twice the wavelength of the absorption peak of the fluorophore being used. 
For example, in the case of fluorescein which has an absorption peak around 500nm, 900 rnn 
excitation could be used. Essentially no excitation of the fluorophore will occur at this 
wavelength. However, if a high peak-power, pulsed laser is used (so that the mean power levels 
are moderate and do not damage the specimen), two-photon events will occur at the point of 
focus. At this point the photon density is sufficiently high that two photons can be absorbed by 
the fluorophore essentially simultaneously. This is equivalent to a single photon with an energy 
equal to the sum of the two that are absorbed. In this way, fluorophore excitation will only occur 
at the point of focus (where it is needed) thereby eliminating excitation of the out-of-focus 
fluorophore and achieving optical sectioning. 

Often, muhiple fluorophores are used, with each fluorophore having a different spectra, 
some of which may overlap. Typically, the ability to distinguish between the respective 
fluorophores is only possible where the excitation and emission spectra are separated, or where 
the fluorescence lifetimes are distinct. 

Another approach is to selectively excite different fluorophores by using various 
excitation photon wavelengths, each of which will approximate the wavelength of the absorption 
peak of a corresponding fluorophore. Such an ajpproach is not practical for a number of reasons. 
Firstly, it is difficult to rapidly tune the excitation wavelength of the laser providing the 
excitation photons. Secondly, there is typically a very broad excitation spectrum, so that such 
an approach makes it difficult to excite a single dye. 

Thus, the need exists for a system and method for efficiently monitoring a plurality of 
fluorescent probes, and to selectively record the signal from those probes for subsequent analysis. 
The present invention addresses these needs. 

SUMIVIARY OF THE INVENTION 

Briefly, the present invention is directed to a system and method for monitoring cellular 
activity in a cellular specimen. According to one illustrative embodiment of the invention, a 
' plurality of excitable markers are applied to the specimen. A multi-photon laser microscope is 
provided to excite a region of the specimen and cause fluorescence to be radiated from the 
region.. The radiating fluorescence is processed by a spectral analyzer to separate the 
fluorescence into wavelength bands. The respective fluorescence bands are then collected by an 
array of detectors, with each detector receiving a corresponding one of the wavelength bands. 
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According to another embodiment, the invention is directed to a system for monitoring 
cellular activity in a cellular specimen that contains a plurality of excitable markers. The system 
includes a laser microscope that is operative to^excite the markers in a region of the specimen, 
so that those markers in the region radiate fluorescence. The system also includes a tunable filter 
that is operative to process the fluorescence and to pass aportion of the fluorescence wavelengths 
radiated by the markers. The system still further includes a detector that is operative to receive 
the processed fluorescence wavelengths. 

In still another embodiment, the invention is directed to a system for monitoring cellular 
activity, including a two-photon laser microscope that is operative to excite the markers in a 
region of the specimen such that the markers in the region radiate fluorescence. The system also 
includes a detector that is operative to receive non-descanned fluorescence from the specimen, 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.l is a schematic diagram of a first illustrative embodiment of the present invention; 

FIG. 2 is a schematic diagram that illustrates one embodiment of a spectral analyzer 
included in the system of FIG. 1; 

FIG. 3 is a schematic diagram that illustrates a system according to another illustrative 
embodiment of the invention; 

FIG. 4 is a schematic diagram that illustrates yet another illustrative embodiment of the 

invention; 

FIG. 5 is a schematic diagram that illustrates still another embodiment of the invention; 

FIG. 6 is a flow chart that depicts the operational flow of processing software to process 
spectral data received by the systems of any of FIGS. 1 through 5 according to one illustrative 
embodiment of the invention; 

FIGS. 7a-c depict emissions spectra for various fluorescent dyes; and 

FIG. 7d depicts a measured spectrum from a specimen that contains plural different dyes. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to FIG. 1, a novel system 10 is disclosed for capturing spectral data from a 
specimen 12 to which a plurality of excitable markers have been applied. In one embodiment, 
at least two. fluorescent dyes (i.e., fluorescent/probes) are applied to the specimen. The 
fluorescent dyes have respective emission spectra that may or may not overiap. In the case where 
the emission spectra are very similar, it becomes difficult to separate out the emission spectra to 
determine the contributions of each of the fluorescent dyes to the observed spectra. System 10 
facilitates making such determinations in an efficient, reliable manner. 

As shown in FIG. 1, system 10 includes a laser 14 that generates laser light. The light 
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emitted by laser 14 is focused by a lens 16 onto a short pass dichroic mirror 18. As is well 
known, the dichroic mirror 1 8 selectively reflects light according to its wavelength. Thus, the 
dichroic mirror is selected such that it reflects the light emitted by laser 14. 
5 The reflected light from dichroic mirror 18 is directed toward scanning optics, shown 

schematically at 20. The scanning optics may include a controllable deflection unit, or any other 
suitable structure that allows the reflected light to be redirected for scanning of the specimen 12 
by the laser light, as is well known to those skilled in the art. 

The directed light from scanning optics 20 is imaged by amicroscope lens 22 onto or into 
the specimen 12. The laser light excites the fluorescent dyes in the region where the light is 
directed, such that those dyes fluoresce and emit light having respective emissions spectra. 

In one embodiment, laser 14 is a two-photon laser. As is well known, a two-photon laser 
microscope depends on the two-photon effect, by which the fluorescent dyes are excited not by 
a single photon, but rather by two relatively low energy jjhotons that are absorbed 
contemporaneously by a fluorescent dye. Thus, the requirement for two coincident (or near 
coincident) photons to achieve excitation of the fluorescent dye means that only focused light 
reaches the required intensities and that scattered light does not cause excitation of the 
fluorescent dyes. As such, a two-photon laser microscope is inherently insensitive to the effects 
of light scattering in thick slices. Alternatively, the laser 14 may comprise some other multi- 
photon laser, or a single-photon laser. 

The fluoresence radiated by the excited dyes is focused by the microscope lens 22, and 
passes through the scanning optics 20 and dichroic mirror 18. The fluorescence is then focused 
by a lens 24 and directed to a light guide 26 that delivers the focused light to a spectral analyzer 
25 28. Spectral analyzer 28 receives the light and disperses the light into respective wavelength 
bands. Each band is detected by a corresponding detector, and the intensity of each band is 
recorded and processed to determine the ingredients of the received fluorescence, as is described 
in more detail below in connection with FIG. 2. 

Referring to FIG. 2, there is shown one illustrative embodiment of spectral analyzer 28. 
30 Spectral analyzer 28 includes a housing 30 formed with a hght entrance opening 32 and a light 
exit opening 34. Light entrance opening 32 is connected to light guide 26 to receive light from 
the light guide. Preferably, the distal end of light guide 26 includes an exit slit 27 to permit the 
delivery of fluorescence from hght guide 26 to spectral analyzer 28. Mounted within spectral 
analyzer 28 is a first mirror 36 that directs the incoming light to a grating 38, which disperses the 
35 light over appropriate wavelength range. The dispersed light is then directed to a second mirror 
40 that directs the dispersed hght through the exit opening 34. In place of the grating 38, spectral 
analyzer 28 may alternatively include a prism or other light-dispersing structure. 
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Aligned with exit opening 34 is a detector array 42 consisting of individual detectors 43. 
The detector array 42 may take many different forms, such as an array of photornultipher tubes 
(PMTs), multiple window-PMTs, position.dependant wire detectors, ^^^^f'^'-'^^!^''' 
Ltecto;.aphotodiodearray,anintensifiedphotodiodearray,charge-^^^^^^^^ 
intensified CCDs, an SIT or other video camera, or any other smtable optical-to-electncal 
transducer. 

In any event, the detector array 42 is preferably a linear array, with the respective 
wavelength bands being incident upon a corresponding one of the detectors 43. Each de^ o 
,0 43inthearrayreceivesthelightincidentuponitandgeneratesacorrespondmganaloge^^^ 

signal Tl.e electrical signals are then introduced to respective analog-to-d.gxtal convert^ 
(sfown schematically at 44) which convert the incoming analog signals mto -rr^P-^J^ 
Lgitalsignals. The digital signals are then delivered to a processor 46 Utatpr^^^^^^^^^^ 
signals to determine the constituents of the emissions spectra, as is described m more detail 
15 below. 

Referring now to FIG. 3. there is shown a system 50 according to an alternative 
embodimentoftheinvention.lnplaceofspectralanalyzer28,system50indudes,n^^^^^ 

52 that is interposed between lens 24 and a single detector 54. for example, a PMT. In one 
embodiment, tLble filter comprises a liquid crystal tunable mter (LCIT) that utaiz. 

20 crystalstocontinuouslyva,ytheretardanceofindividualfilterstages,resultmgm^ 

filterthatiselectricallytunableoverawidespectralrange. Altematweb|. the tunable fiU^ 52 
may comprise an acousto-optical tunable filter. In any event, tunable filter is control!^ by a 
suitable control unit 56 to vary the bandpass of the filter through the spectral ^^^J^ 
bandpass, detector 54 receives fluorescence and generates a corresponding ^'^^'^f '^^' 
25 signal, which is converted to digital format by an analog-to-digital converter 58 and then 
introduced to processor 46 for processing. 

Referring now to FIG. 4. there is shown a system 60 according to still another 
embodiment of the invention. System 60 includes a long pass dichroic imrror 62 placed in the 
«ghtstreambetweenthescanningoptics20andthemicroscopelens22. The dichroic mirror 62 
isselectedsuchthatwavelengthscorrespondingtothefluorescenceradiatedbythe^^^^^^^^^^ 
reflected by the mirror 62. while the laserlight from laser,14 passes through without beng 
reflected. L Reflected fluorescence is directed to a focusing lens 64. and then introduced to 
light guide 26 which delivers the light to spectral analyzer 28. As descnbed above, speara 
LZ disperses the light and passes the light on to ADC 44. which converts the respective 
bands into digital signals and introduces the digital signals to processor 46. 

System 60 is therefore suitable for use in comiection with a non-descanned two-photon 
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microscope. By diverting the radiated fluorescence before it passes through the scanning optics 
. 20, a signal of increased intensity is received by spectral analyzer 28, as compared with a signal 
that passes through scanning optics 20 and dichroic mirror 1 8 before being received by a spectral 
. analyzer or detector. Thus, the dwell time at each pixel can be reduced as a result. 

Referring now to FIG. 5, a system 70 is shown according to another embodiment of the 
invention. System 70 includes a light collector 72 that substantially surrounds specimen 1 2 and 
includes a reflective inner surface. Thus, hght emitted by fluorescent dyes within specimen 12 
are collected by the collector, regardless of the direction in which the light radiates. In one 
10 embodiment, collector 72 comprises an integrating sphere. Alternatively, collector 72 m ay be 
in the shape of an ellipsoid or other structure that substantially encompasses specimen 12 to 
collect a substantial amount of the light radiating from specimen 12. for example, an elliptical 
mirror. Collector 72 coraiects to light guide 26 to deliver the collected light to spectral analyzer 
28. 

^ 5 Thus, in use of the various systems described above, laser light is directed by dichroic 

mirror 1 8, scanning optics 20, and focusing lens 22 to a region of specimen 1 2. The photons 
(either from a single-photon laser or from a multi-photon laser) excite the fluorescent dyes in the 
region, causing them to fluoresce. The entire emitted spectrum is received and processed 
simultaneously in certain of the illustrative embodiments to speed up thecoUection process. The 

20 spectral information is then processed to detemiine the amounts of each dye contributing to the 
emitted spectrum. 

Referring now to FIG. 6, operation of processor 46 is described in greater detail. In one 
embodiment, processor 46 is programmed to execute a linear unmixing operation upon the 
incoming spectral data to approximate the quantities of each fluorescent dye that contributed to 
the emitted spectrum. As shown in FIG. 6, operation begins at step 1 00 by determining spectral 
characteristics for the respective individual fluorescent dyes. As is well known in the art, each 
of the fluorescent dyes emits a particular spectrum over a certain wavelength band and at certain 
varying intensities within that band (see FIGS. 7a-c which illustrate examples of emissions 
spectra for three different fluorescent dyes). At step 102, data relating to the probe spectra is 
recorded in processor memory for subsequent retrieval. 

At step 1 04, processor 46 receives the measured imaging spectrum data from ADC 44 
(see FIG. 7d), and retrieves the characteristic spectra for the various fluorescent dyes. At step 
106. the measured spectrum is decomposed into the various component dye spectra. This can 
35 be accomplished in many different ways. In one embodiment, processor 46 generates a model 
spectrum from the individual templates, and compares the model spectrum with the actual 
recorded spectrum. The respective weights of each of the individual templates are then varied 
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to arrive at a close approximation of the actual spectrum. Then, at step 108, processor 46 
determines the weights of each dye to quantitate the respective dye intensities. 

In another ranbodimant, processor 46 is prograrhmed to carry out principal component 
> analysis (PCA) on the incoming data. As is well known in the ait^PC^s a Unear model which 

of linear combinations of the 

traiiblOrillb mc Uii^uiax vcuiai^iv^o **** 

original variables called principal components, that account for the variance in the original data 
set. Suitable forms of PCA algorithms are disclosed in U.S. Patent Numbers 5,991,653 to 
Richards-Kortum et al., and 5,887,074 to Lai et al., the disclosures of which are hereby expressly 
10 incorporated by reference. 

Preferably, system 10 uses a single excitation to excite the respective dyes (i.e., the dyes 
are pan-excited). In this manner, all of the dyes are excited at once by using a single wavelength. 
Thus, there is no need for using more than one wavelength, nor is there a need to take multiple 
images and overiay the respective pixel images to generate a complete image. Alternatively. 
^ 5 system 1 0 may use multiple excitations, such as two excitations, to excite the dyes, especially 
in situations where it is desirable to cover a relatively broad span of dyes. 

From the foregoing, it will be apparent to those skilled in the art that the present invention 
provides an efficient and reliable system for receiving and processing emissions spectra in 
connection with fluorescence microscopy. The system processes the emissions spectra to 
determine concentrations of plural fluorescent dyes in a particular spectrum, even where the 
wavelength bands of the dyes overlap. 

While the above description contains many specific features of the invention, these should 
not be construed as limitations on the scope of the invention, but rather as one exemplary 
25 embodiment thereof. Many other Vafiations are possible. Accordingly, the scope of the 
invention shouldbe determined not by the embodimems illustrated, but by the appended claims 
and their legal equivalents. 
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What is claimed is: 

1. A method of monitoring cellular activity in a cellular specimen, comprising: 
applying a plurality of different excitable markers to the specimen; 

' applying light to the specimen from a mtilti-photon laser microscope to excite a 

region of the specimen and cause fluorescence to be radiated from the region by the markers m 

that region; 

separatingthe fluorescence into wavelength bands using a spectral analyzer, and 
10 detecting the fluorescence through an array of detectors, with each detector 

receiving one of the wavelength bands and generating a corresponding signal. 

2. The method of claim 1 , wherein separating the fluorescence includes using a 
grating. 

3. The method of claim 1 , wherein separating the fluorescence includes using a 

prism. 

4. The method of claim 1. wherein separating the fluorescence includes usmg a 
Uquid crystal tunable filter. 

5. The method of claim I, wherein separating the fluorescence includes using an 

acousto-optical tunable filter. 

6. Themethodofclaiml.whereinapplyingapluralityofexcitablemarkersincludes 

applying a plurality of fluorescent probes to the specimen. 

7. The method of claim 1, wherein detecting the fluorescence includes using a 
25 pluraHty of photomultiplier tubes. 

8. The method of claim 1, wherein detecting the fluorescence includes using" a" 
plurality of high gain photomultiplier tubes. 

9. The method of claim 1, wherein applying light to the specimen comprises 
30 applying light from a two-photon laser microscope. 

10. A system for monitoring cellular activity in a cellular specimen that contains a 

plurality of excitable markers, the system comprising: 

a laser microscope that is operative to excite the markers in a region of the 

specimen, wherein the markers in the region radiate fluorescence as a result; 

a tunable filter that is operative to process the fluorescence and to pass a portion 
of the fluorescence, wherein the portion of the fluorescence is within a wavelength band that 
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depends on the setting of the filter; and 

a detector that is operative to receive the processed fluorescence and to convert 

the fluorescence into a corresponding signial. 

11. The system ofclaim 10, wherein the tunable filter comprises a liquid crystal 

tunable filter. 

12. The system of claim 10, wherein the tunable filter comprises an acousto-optical 
tunable filter. 

13. The system ofclaim 10, wherein the detector comprises a photomuhiplier tube. 

14. The system of claim 10, wherein the detector comprises a high-gain 
photomultiplier tube. 

15. The system of claim 10, wherein the laser microscope comprises amulti-photon 
laser, microscope. 

16. A system for monitoring cellular activity in a cellular specimen that contains a 
plurality of excitable markers, the system comprising; 

a multi-photon laser microscope that is operative to excite the markers in a region 

of the specimen, wherein the markers in the region radiate fluorescence as a result; 

a deflector positioned relative to the specimen to deflect non-descamied 

fluorescence radiated by the markers; 

aspectralanalyzeroperativetoreceivethedeflected,non-descannedfluorescence 

fi-om the deflector and to disperse the fluorescence; and 

25 a detector array that is operative to receive the dispersed fluorescence from the 

. spectral analyzer and to generate corresponding signals. 

17. The system of claim 16, wherein the detector anray comprises a plurality of 
photomultiplier tubes. 

18. The system ofclaim 16, wherein the detector array comprises a plurality of high- 
gain photomultiplier tubes. 

19. A method ofmonitoring cellular activity in a cellular specimen, comprising: 

applying a plurality of different excitable markers to the specimen; 
focusing lightupon aregion ofthe specimen from a laser microscope to excitethe 
markers in the region and cause fluorescence to be radiated by the markers in the region; 
separating the fluorescence into wavelength bands; 
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detecting the fluorescence through an array of detectors, with each detector 
receiving one of the wavelength bands and generating a corresponding signal; and 

processing the signals from the detectors to calculate the quantities of each marker 

in the region. 

20. The method of claim 19. wherein separating the fluorescence includes using a 
grating. 

21. The method of claim 1 9, wherein separating the fluorescence includes using a 

prism. 

22. The method of claim 19, wherein separating the fluorescence includes using a 
liquid crystal timable filter. 

23 . The method of claim 1 9, wherein separating the fluorescence includes using an 
acousto-optical tunable filter. 

24. The method of claim 19, wherein applying a plurality of excitable markers 
includes applying a plurality of fluorescent probes to the specimen. 

25. The method of claim 19, wherein collecting the fluorescence includes using a 
plurality of photomultipUer tubes. 

26. The method of claim 1 9, wherein collecting the fluorescence includes using a 
plurality of high gain photomultipUer tubes. 

27. The method of claim 19, wherein applying light to the specimen comprises 
applying Hght from a two-photon laser microscope. 

28. The method of claim 1 9, wherein processing the signals comprises performing 
linear unmixing on the signals. 

29. A system for monitoring cellular activity in a cellular specimen that contains a 
plurality of excitable markers, the system comprising: 

a laser microscope that is operative to excite the markers in a region of the 
specimen, wherein the markers in the region radiate fluorescence as a result; 

a collector that at least substantially envelops the specimen to receive fluorescence 
from the markers; 

a spectral analyzer connected to the collector to receive the fluorescence and 
process same to disperse the fluorescence; and 

a detector that is operative to receive the dispersed fluorescence and to convert 
the fluorescence into corresponding signals. 
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30. The system of claim 29, wherein the collector comprises an integrating sphere. 

31. The system of claim 29, wherein the detector comprises an array of 
photomultiplier tubes. 

32. The system of claim 29, wherein the detector comprises an array of high-gain 
photomultiplier tubes. 

33. The system of claim 29, wherein the laser microscope comprises a multi-photon 
laser microscope. 
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